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Abstract 

We present results concerning when the joint distribution of an ex¬ 
changeable sequence is determined by the marginal distributions of its 
partial sums. The question of whether or not this determination occurs 
was posed by David Aldous. We then consider related uniqueness prob¬ 
lems, including a continuous time analog to the Aldous problem and a 
randomized univariate moment problem. 
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1 Introduction 


In probability theory, there are many results concerning uniqueness of a dis¬ 
tribution satisfying certain properties. For instance, there are the various mo¬ 
ment problems, the inversion of the characteristic function, the inversion of the 
Laplace transform. Another kind of uniqueness result relates to exchangeable 
sequences of random variables. Given the joint distribution of an exchangeable 
vector X = (A„)„gN, it can be written as a “mixture” of iids in exactly one 
way. 

We will prove altered versions of these types of results. Roughly speaking, 
we will assume only partial information, and make regularity assumptions to 
ensure that the resulting problem is well-defined. In the process, we show a 
trend of what types of obstructions there can be to such uniqueness results: 
arithmetic and algebraic structure. (These two notions are related because 
arithmetic relationships between exponents, say in a Laplace transform, will 
correspond to polynomial relationships between the exponentials, for instance 
the Laplace transforms.) 

In [T], (p. 20) Aldous proposes the following question. 

Question 1.0.1. Let X = {Xj)j^ff, Y = (Yj)jgN be exchangeable sequences of 
M.-valued random variables, with = ^2]=! Suppose that 

\fn > 1 we have Sn =d Tn- Does it follow that X =dY ? 

Despite this question being over 30 years old, only partial progress has been 
made on it. In [3] Section 2, Evans and Zhou show the answer is negative in the 
class of signed random variables. Therefore, interest has somewhat shifted to 
the nonnegative case. In [5], it is shown that there is an affirmative answer if we 
know that X and Y are mixtures of countably many nonnegative iid sequences. 
We will show that the nonnegative restriction does not improve the situation 
in the absence of the additional assumption of [3]: X cannot be determined 
uniquely from this partial information even if Xj > 0. However, as we will see, 
uniqueness holds when the exchangeable sequences are mixtures of up to 3 iid 
sequences. 

Uniqueness is also true for more complicated mixtures, so long as the iid 
sequences involved in the mixture are related “transcendentally”. (It is the 
main purpose of this paper to present results which make this theme precise, in 
the context of all uniqueness questions we will consider.) We may think of the 
heuristic, “mixtures of a small number of distributions exhibit uniqueness of A”, 
as a special case of the heuristic about arithmetic and algebraic (polynomial) 
dependence. For instance, if the collection of allowed distributions in the is 
small, then there cannot be too many arithmetic dependences. 

The first question naturally leads to the following continuous time analog, 
suggested by J. Cerny. 

Question 1.0.2. Let St and Tt be mixtures of Levy Processes. Suppose that 
\ft > 0, St =d Tt- Is {St)t>o jointly equidistributed with {Tt)t>o? 
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We will see that in the case of restricting to mixtures of Brownian Motions, 
the answer is yes. However, we will find a (possibly unexpected) parallel be¬ 
tween a measure similar to the Levy measure implied in this problem and the 
mixing measure implied in Question ll.O.ll In particular, we will find that upon 
restricting to even just Poisson Processes, uniqueness fails. 

For a Levy Process, knowing the marginal at any time t 7 ^ 0, such as t = 1, 
tells us the entire joint distribution of the process. However, this will not be true 
for a mixture of Levy Processes. We will see that in some cases, we could say St 
is unique just from making observations at t S N and other times we require all 
t > 0. In the former case, the continuous time problem makes uniqueness of St 
more plausible than the discrete time case only because continuous time imparts 
infinite divisibility which limits the possible distributions that can occur in the 
mixture. In the latter case, the continuous time problems will tend to exhibit 
uniqueness over their discrete time counterparts not only because of infinite 
divisibility, but because observation at noninteger t’s provide more information 
beyond that. 

An example of where the fact that we make continuum observations makes 
a difference, at least in the argument, is the case of a mixture of normal dis¬ 
tributions or Brownian motions. In this case, the continuum of observations 
destroys the arithmetic structure, making uniqueness a fact in the Brownian 
Motion case, as opposed to an open problem in the discrete time case. 

In light of these questions, it is natural also to consider various random 
analogs of uniqueness problems from the classical theory of random variables. 
For instance, one such a question are posed below: 

Question 1.0.3. Let a,/3 be random Borel measures on R. Suppose that their 
moments (which are random variables) J^x'^da and are well-defined 

and equal in marginal distribution (i.e. for one n at a time). Do we have 
a=dP? 

Question II. 0.31 can be viewed as a randomization of classical uniqueness 
theorems, in the sense that the probability measure one tries to recover is de¬ 
terministic in the classical theories, and we now take it to be random. 

We will see that in all randomized versions of classical uniqueness problems 
we consider, knowing joint information is enough to assert uniqueness of the 
original random measure in distribution, but knowing marginal information is 
not enough. We will see that the existence of counterexamples again depends 
on the arithmetic and algebraic structure. 

The layout of the paper is as follows. We will treat Question ll.O.ll in Section 

2, Question 11.0.21 in Section 3, and the questions similar to Question 11.0.31 in 
Section 4. Section 3 is fairly technical, but Section 4 does not depend on Section 

3, so Section 3 could be omitted on a first pass. In each of the sections, we will 
first discuss the results required to make the questions precise and the dehnitions 
associated to the corresponding question. We also discuss the machinery to be 
used in the rest of the section. In subsections, we consider answers to the 
question in various cases. 
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2 Discrete Time Exchangeability Problem 

In this section, we consider Question II. 0.11 posed by Aldous. We keep the 
notation used in the statement of the question, so that X = (Xj) and Y = (Yj) 
will denote sequences of exchangeable random variables. 

First we state the following without proof: 

Lemma 2.0.4 (Classical Bounded Moment Problem). Let V = (Vy) and Z = 
{Zy) be vectors indexed by the same setT of arbitrary cardinality. Thus V and Z 
are valued in Assume that for each 7 S F, Vy^Zy are bounded real random 
variables. Then V and Z have the same distribution if and only if they have the 
same joint moments, i.e. Vjqi,..., 7;} C F Vri, ... ,ri S N 

E('n7-j =E(n2;.j (1) 


We will have need throughout the paper for the notion of a random measure. 
In general, we will use P{DJf) to denote the (Borel) probability measures defined 
on a standard Borel space 9Jl. Similarly, we define M_|_(9}I) to be the collec¬ 
tion of finite nonnegative Borel measures on 9Jl. In each case, give these spaces 
the measurable structure generated by the mapping ^ i-)- £ Borel(9Jt). 

Since DJI is standard Borel, so is P(9It) with the topology given by vague conver¬ 
gence. The Borel a algebra determined by vague convergence is an equivalent 
definition of the measurable structure given to P(JXfl). (For these facts, see 
for instance [5].) A random measure is then a random variable taking values 
in either M+(9Jl) or P{D}t). We will always deal with Polish spaces when the 
topology is significant, and standard Borel spaces if not. We almost always deal 
with probability measures, i.e. except when dealing with Levy measures. 

From now on we will use 


Vs > 0, Cfj,{s) = ( e ^^dyb{x) (2) 

J [0,oo) 

to mean the Laplace transform (at s > 0) of a probability measure fx on [0, 00 ). 
Let = {fi £ P(IR)|^ is supported in [0, 00 )}, which is closed in P(R). If is 
random, then the Laplace transform will simply be a random variable. 

In this section, we will use symbols a, 0 : 1,02 to denote random probability 
measures and 0,0i,02 to denote elements of P(P(R)). Symbols Xj,Yj will 
denote real-valued random variables. 

Definition 2.0.5. For each j > 1, let Xj be a real-valued random variable. Call 
X = (Xj)j^jq exchangeable if whenever tt : N —>■ N is a finite permutation, we 
have that 

(Aj)iGN =d (X^(j))iGN- (3) 
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Definition 2.0.6. Say that X is iid-Q if its distribution is given by 


VA € Borel{R^), P{X G A) = 


de{0) 


Definition 2.0.7. Say that X is a mixture of iids directed by a, where 
a is defined on the same probability space as X, if is a regular conditional 
distribution for X given a{a). 

By definition of regular conditional distribution this is just the same as saying 
that whenever Ai,..., An € Borel{M.) we have for a probability 1 set of w, 

PiXi e Ai,l < i < n\a{a)){uj) = a(u;, Ai). (5) 

i 

We now state the well-known theorem of De Finetti. 

Theorem 2.0.8 (De Finetti). The following are equivalent: 

1. X is exchangeable 

2. X is a mixture of iids directed by some a 

3. X is iid-Q for some 0. 

Remark 2.0.9. For each exchangeable law y on there exists a unique law 
0 on P(]R) for which any X with distribution y is iid-Q. This assignment 
y 1 -^ Q is a bijection from the exchangeable laws on to P(P(R)). In fact, it 
is a homeomorphism. Also, if X is exchangeable then its directing measure is 
unique up to a.s. equality, and the distribution of the RV a is 0. Therefore, if 
the (joint) distribution of X is determined, then the law of a is determined. 

In the literature, the phrase “mixing measure” refers to both 0 and a. We 
will use the terminology for 0 and call a the directing measure. In contexts 
when we have two exchangeable sequences X and Y, we denote by 0i,q;i the 
mixing measure, directing measure (respectively) for X and 02,02 the mixing 
measure, directing measure (respectively) for Y. Symbols 01 , 02,0 will always 
refer directing measures, not arbitrary random measures. 

We set Sn = X]j=i T„ = X]j=i Our question is then whether 

Vn, Sn =d Tn implies 0i = 02 (or ai =d 02 ). 

Towards this, let us define: 

Definition 2.0.10. Let L C PfR) be measurable. We will say that L is good 
provided that whenever 0 i,02 are concentrated on L and Vn, S'„ =d Tn, we 
have 01 = 02 . 

To determine if a class L is good or not, we may use the following 

Lemma 2.0.11. A measurable class L C P'^ of distributions is good if and only 
i/Voi ,02 a.s. L-valued, we have that 

Vs > 0, jCci (s) =d (s) (6) 

implies 0i = 02 . 
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Proof. We have that the statement \/n, Sn =d Tn is equivalent to the statement 

Vn,s > 0, (7) 

which, using the definition of a directing measure, is equivalent to 


Vn, s > 0, E 

( [ e 

= E 

( [ e '”^^ 02 ( 3 ;)^ 


\JlO,oo) ) 


_VJ[0.oo) J 


By the classical bounded moment problem, this is equivalent to 

Vs > 0, £ai(s) =d >Ca 2 (s). (9) 

□ 

We do not assert the analogous statement for MGFs (moment generating 
functions) because we have no need for it even though it is true under suitable 
boundedness hypotheses. We do not assert a statement for the characteristic 
function case because the characteristic function would be a complex-valued 
random variable, and one would need the joint distribution of the real and 
imaginary parts. The absence of an analogous lemma for characteristic functions 
is related to the absence of a bounded moment problem for complex-valued RVs 
that does not involve knowing any conjugate moments. This can be thought of 
as a heuristic reason for the shift in focus away from signed random variables 
in the recovery problems we consider in this article. 

2.1 Known Results 

In this section, we will discuss results known beforehand. Using the conditional 
SLLN, it follows that 

Proposition 2.1.1. £’({0,1}) is good. 

In Section 2 of [3], it is shown that 

Proposition 2.1.2. P(R) is not good. 

In Section 3 of the same paper, it is shown that a positive result can still be 
salvaged. 

Proposition 2.1.3. //Vn, S'„ =d Tn, and 0i,02 are purely atomic, concen¬ 
trated in P'^ then X =d Y. In other words, any countable subset of P~^ is 
good. 

Interestingly enough, Muntz’s Theorem, which arises in Lemma 3.3 of [3], 
can be replaced by the theorem of complex analysis stating that holomorphic 
functions defined on a connected open set agree just as soon as they agree on a 
set of points that accumulates within the domain. 
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Their assumption is of a different nature than what we will consider; they 
restrict the size of the sets where 0i, 02 are concentrated rather than requiring, 
as we will, that 0i, 02 are concentrated on a nice set of distributions that may 
be a continuum. Considering that the general problem has been solved in the 
negative, we will primarily address restrictions of the latter type, hence the 
terminology of such a set L being “good”. A particularly interesting case is 
when L is contained in . 

For example, let V denote the collection of distributions in P(R) which are 
the distribution probability measures for Poisson RVs. (So n GV should satisfy 
V/c > 0, /i({fc}) = e~^X^/kl for some A > 0.) Similarly, define £ for exponentials, 
G for geometries, and for binomials with parameter n fixed and p G [0,1] 
varying. It is an exercise in analysis to see that: 

Remark 2.1.4. Bn,G,£,'P are all good. 

2.2 The Relationship Between the Aldons Qnestion and 
Arithmetic Properties of the Valne Set 

In this subsection, we will present one substantiation of the heuristic that the 
more arithmetic dependences there are in the allowed value set for Ai, the 
harder it is to recover X uniquely. Fix A = {ai,...,ajv} when N G N oi 
A = {ai,...,} when N = oo. Assume, for technical reasons, that A has no 
accumulation points in R. We allow negative values in A. Define Fa C P(R) 
to be those distributions that are supported in A. (We can say “supported” 
instead of “concentrated”, because A is closed. Fa is closed because A is.) We 
set L := Fa- For X exchangeable, it is equivalent to say that Xi G A a.s. or to 
say a G L a.s. or to say 0 is supported on L. 

Theorem 2.2.1. Fa is good if A is linearly independent over Q. 

Proof. It suffices to handle the case in which A is discrete, infinite, i.e. N = oo, 
because subsets of good sets are always good. We have X,Y exchangeable 
sequences, which therefore comes with directing measures and mixing measures 
by Remark 12.0.91 Since we are trying to prove goodness, we assume Vn > 
0, Sn =d Tn. (In future proofs of goodness, we not explicitly mention this.) We 
need to see that ai =d a 2 - It suffices to see that (ai({aj}))jgN =d (a 2 ({aj}))jeN 
Suppose that M gN. Then by using the linear independence hypothesis for 
our value set and the properties of directing measures, we have that Vri,..., tm, 
with s = D 




( 10 ) 
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Here, the first and third equality hold because the linear independence hypothe¬ 
sis guarantees that the only way that a sum of elements from A can be 
is if ri copies of are used for each i < M. 

Now lemma 12 . 0.41 completes the proof. □ 

It is also acceptable to have a few arithmetic dependences: 

Proposition 2.2.2. i^{o,i,2} *5 good. More generally, let fj,i, fi 2 , fJ-s S P'^ and 
let , £2, £3 denote their Laplace transforms respectively. Let 

L := {oi^i +a 2 tJ -2 +a 3 fj. 3 \ai + 02 + as = 1,01,02,03 > 0 }. ( 11 ) 

Then L is good. 

Proof. We prove the more general claim. We may assume that no strict subset of 
{pLi,pL2, pis} has convex hull containing all of pi, P2, P3 because subsets of good 
sets are good. From this, it follows that L is homeomorphic to T3 := {(o, b, c)|o+ 
b + c = l,a,b,c > 0} because the map taking (o, b, c) 1 —api + bp2 + cps is 
invertible, and therefore because £3 and L are both compact Hausdorff, they 
are homeomorphic via this assignment, hence measurably isomorphic. 

Proceeding by way of Lemma 12 . 0.111 and using the homeomorphism above, 
we are reduced to showing that if Lf, V are £3-valued random vectors for which 
Vs > 0 we have 

(£i(s),£2(s),£3(s)) • U =d (£i(s),£2(s),£3(s)) • F (12) 

then U =d V. That this is enough follows from the fact that when U, V are 
the pushforwards of ai, a2 via the homeomorphism above, the left side has the 
distribution of the (random) Laplace transform of ai evaluated at s, and the 
right side has the distribution of the (random) Laplace transform of 0:2 evaluated 
at s. 

Because U, V are probability vectors, it suffices to show that if U', V are 
bounded random vectors in with 

(£i(s) - £3(5), £2(5) - £3(5)) • U' =d (£i(s) - £3(3),£2(5) - £3(5)) • W ( 13 ) 
then U' =d V . 

We will check that the collection of u’s of the form 

V = c(£i(s) - £3(3),£2(5) - £3(3)) ( 14 ) 

cover a nonempty open set as s > 0 and c € M vary. We know that pi — /is is a 
signed measure on [ 0 , 00) and as is p2 — ps- We may regard £i(s) — £3(5) and 
£2(3) — £3(5) as the Laplace transforms of these signed measures respectively. 
Therefore, a nonempty open set of u’s are of the form m- For instance, one 
may check that the derivatives of £i(s) — £3(3) and £2(3) — £3(5) must be 
different at some sq > 0, for if they were the same, then pi — ps and p2 — ps 
would have the same Laplace transform. 

Bivariate analytic functions agreeing on a nonempty open set in have to 
agree, and we apply this to the bivariate MGF of U' and that of F'. □ 






2.3 Four Values are Too Many 

We will see our first counterexample to the nonnegative Aldous problem, proving 
the claim 

Proposition 2.3.1. P+ is not good. 

We will even show that 

Theorem 2.3.2. i^{o,i, 2 , 3 } *5 'not good. 

In order to prove this theorem, we must develop the following. 

First we need some definitions 

Definition 2.3.3. Fix d > 0. A subset S of M.‘^ is said to be determining 
if whenever U and V are bounded -valued random varaibles such that Vs € 
S, s ■ U =d -V implies that U =dV. 

As mentioned multiple times in the introduction, algebraic properties of 
certain restrictions will be important. Thus it is no surprise that we need to 
consider the 0 set of polynomials. 

Definition 2.3.4. A subset S of is called a projective variety if there 
exists a degree-homogeneous polynomial p defined on M.‘^ such that p 0 and 
p-\0) = S. 

The next result, based on the work of Cuesta-Albertos, Fraiman, and Rans- 
ford in [ 5 ] (Theorems 3.1 and 3 . 5 ), and the subsequent proposition will be used 
throughout this article. 

Lemma 2.3.5. Fix d>l. A subset S ofW^ is determining if and only if it is 
not contained in any projective variety. 

We will borrow the ideas found in [ 2 ] in order to prove this lemma. 

Proof. Fix d > 1 and S C We assume that S is nonempty because the 
claim is true if S is empty. 

Suppose S is not contained in any projective variety, and consider two 
bounded random variables U, V. For each n > 0 , we define the polynomial 

p{x) = E[(x • t/)”] - E[(x • F)”] ( 15 ) 

which is homogeneous of degree n. Since p vanishes on S, it follows that p must 
be the 0 polynomial. It follows that Vx € we have that all the moments 
of the real-valued, bounded random variable x ■ U are equal to those of x ■ F. 
Hence Vx S we have x ■ U =d x ■ V, thus U =d V. 

For the converse, it suffices to assume that S' is a projective variety and 
construct two different probability measures p, and v with bounded support, 
defined on K'^, such that \/s € S, s ■ p = s ■ v. Here, if t/ is ^ distributed then 
s ■ p means the distribution probability measure oi s ■ U and similarly for v. 
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Define an auxiliary function / : —>■ C given by 


/(-) := n 

i=l 


( 16 ) 


Here, we have z = (zi,, Zd). 

It is routine to verify that 

(i) / is even, entire, and real valued when restricted to 

(ii) / is of exponential type, i.e. there is a C > 0 such that Vz we have 
|/(•^)| < C'e^j=i 

(iii) There is a C > 0 such that Vx S we have |/(a;)| <C/(\ + ||a^|P)- 

(iv) we have /(O) ^ 0. 

Now, find p a homogeneous polynomial on R"^ that is not a constant such 
that S C p“^(0). The reason p can be chosen to be not a constant is that S is 
nonempty. Define ^ : R"^ —>■ R by g{x) = p{x)^ f (x)^, where K is chosen large 
enough so that g G L^(R'^). This is possible by (hi). Let h = g he the Fourier 
transform of g. By Plancherel’s theorem we have that h € L^(R‘^) and h is real¬ 
valued since g is even and real-valued. Moreover, the Paley-Wiener theorem 
tells us that h is supported in a compact subset of R'^. Here, we are applying 
Paley-Wiener to g which is exponential type, analytic because / is exponential 
type, analytic. (We extend the definition of p to C"^.) But, depending on 
the convention of the Fourier transform, we already know the inverse Fourier 
transform of g in terms of h. This shows that ft, is 0 off of a compact set. 

Define finite, positive Borel measures with compact support by 

pL = h^dx, V = h~dx, (17) 

which are mutually singular and therefore not equal. Using the Fourier inversion 
theorem, there is a constant c ^ 0 depending on the conventions of the Fourier 
transform and its inverse, such that 

p — V = eg = cp^f^ on R'^. (18) 

Evaluating this equality at 0 € R"^ we find that 

p{R‘^) - :y(R‘^) = cp(0)V(0)^ = 0. (19) 

Since p and v are both nonzero (because g is not zero, p is not zero, so ft is not 
zero) and have the same total mass, we may renormalize if necessary to force 
them to be probability measures. 

We also have that for any x x ■ p = x ■ v \i and only if Vt G R we have 
p{tx) — v{tx) = 0 if and only if Vt G R, cp{tx)'^ f (tx)^ = 0. Thus, Vx G S' we 
have p(x) = 0 and thus x ■ p = x ■ v. 

This completes the proof that S is not determining, because p and v are 
distributions of bounded random vectors with values in R"^ for which their pro¬ 
jections along vectors in S agree in law, but they are not equidistributed with 
one another. □ 
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Part of the utility of presenting the above proof is to show how constructions 
in the sequel that use this lemma can be made explicit. We have now stated and 
proven what we need from the existing literature. We use the above to prove 
the following proposition, which will drive many constructions in this article. 

Proposition 2 . 3 . 6 . There exist U V which are valued in the unit tetrahe¬ 
dron 


3 

T 4 := {{xo,xi,X2,X3)\Vj e {0,1, 2, 3}, Xj > 0, '^Xj = 1 } C (20) 

j=o 

such that \/y € R we have C4{y)-U =d C4{y)-V. Here, 04(2/) = ( 1 , y, j/^, y^) € R^. 

Proof. Let 03(7/) = (l,?/,j/^) G R^ for all y G R. By Lemma [ 2 . 3.51 there exist 
W = (Wi,W2, W3) ^d'Zi = {Zi, Z2, Z3) bounded R^-valued RVs such that 

Vy G R, C3(y) • W =d C3(y) ■ Z. ( 21 ) 

Let H = {{x,y,z) G R^|l >x>y>z>Q}. Observe that H has nonempty 
interior. Therefore, given any compact set C C R^, there exist a G R, a ^ 0, 
6 G R^ such that aC h c H. Because m is unchanged by rescaling and 
translation, we may assume that W, Z are iJ-valued. Define 


Do = 1 - Wi 
Ui = Wi- W2 
U2 = W2- 1^3 

t/3 = W3 - 0 

U = {Uo,Ui,U2,U3), 


Vo = 1-Zi 
Vi = Zi- Z 2 
V 2 = Z 2 — Z 3 
V3 = Z3-0 

V = (Vo,V 4 ,V 2 ,V 3 ). (22) 


Observe that U and V are Tj-valued. From linear algebra (invertibility of 
the linear transform linking {Ui,U 2 ,U 3 ) to W and (Di, 1 ^ 2 , 14 ) to Z) it follows 
that (C/i, D2, C/3) (Vi, V 2 , V 3 ) so that U ^d V. By ([2T]) we have 


Vy G R, C3(y)-(C/i+D2+t/3, U 2 +U 3 , U 3 ) =d C3(y)-(Di+D2+R3, t^2+1^3, t^s)- ( 23 ) 
Plugging in the explicit form of C3(y) yields 

Vy G R, C/i + (l + y)D2 + (l + y + y^)C/3 =d Pi + (l+y)D2 + (l + 2/ + 2/^)V;3- ( 24 ) 
Multiplying by (y — 1 ), we obtain 


Vy G R, (y - l)Di + (y^ - 1)^2 + (y" - 1)U3 =d 

(y - l)Di + (y 2 - 1)V2 + (y^ - 1)^3. ( 25 ) 
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Thus, by definition of Uo,Vo we learn that 

Vy G R, C4(y) • U =d 04 ( 2 /) • V. (26) 

We have shown that U, V have the required properties. □ 

We are now ready to establish Theorem 12.3.21 

Proof of Theorem \ 2.3. 2[ Obtain U, V from Proposition [5321 Define ai and a 2 
so that 

U=d (^ai({0}),ai({l}),ai({2}),ai({3})) (27) 

and 

D =d (^a2({0}), a2({l}), a2({2}), a2({3})) . (28) 

Strictly speaking, a \, may not be directing measures for some exchangeable 
sequence, but the distribution of ai,a 2 are still elements of P(P(K)) and are 
thus mixing measures, from which we may extract directing measures that have 
the same distribution as ai, a 2 - Thus, we may assume without loss of generality 
that ai, 02 are already defined on an appropriate probability space so that they 
are directing measures. In the future, this argument will not be explicitly stated. 
By a change of variables in Ci{y) from Proposition 12.3.61 we have Vs > 0, 

-Cai(s) = 

^ai({0}), ai({l}), ai({2}), ai({3})^ =d 

(a2({0}),a2({l}),O2({2}),a2({3})) = 

C.C.M (29) 

However, we have that the corresponding 0i and 02 are distinct because U 
and V have different distributions, hence as do oi and 02 - Thus, 0i, 02 have 
the required properties when we use Lemma 12.0.111 to prove that P{o,i, 2 . 3 } is 
not good. □ 

2.4 A Generalization of the Four-Valne Case 

We may regard the values 0,1, 2, 3 as independent sums of 0 copies of 1, 1 copy 
of 1, 2 copies of 1 and 3 copies of 1 respectively. We may replace the constant 
random variable 1 with any nonnegative distribution to obtain a generalization 
of Theorem 12.3.21 


(e-°",e-i",e-2",e-3") • 
(e-°",e-i",e-2",e-3") • 
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Proposition 2.4.1. Let ^ G P~^ be nondegenerate and let * denote convolution. 
Let L be the collection of convex combinations of Sq, fj,, fj,* g,* g,* fi. Then L is 
not good. The same is true of the convex combinations of Sq, g,* g,, gL* gi* .... 


The primary purpose of this subsection is to prepare for comparisons and 
analogies with material from subsection 13.21 for which the case in which g, is 
Poisson is important. The techniques themselves are not logical prerequisites 
for material in the sequel. 

Proof. To imitate the last proof, we need a homeomorphism between T 4 and L. 
We propose the map assigning a vector (a, &, c, d) G T 4 the element aSo + bg + 
eg * g + dg * g * g oi L. This map is surjective. To see it is injective, if there 
are (a, &, c, d), (o', b' ,c', d') with aSo + bg + cg*g + dg*g*g = a'So + b' g + c'g * 
g + d'g * g * g then taking Laplace transforms we have that Vs > 0, 

aCf^{s)° + bCfj,{sY + cCfj^is)"^ + d£^(s)^ = 

a'C^{sf + b'e^isf + c'/:^(s)2 + d'C^{sf. (30) 

Consider the operation of multiplying by C^{s), then taking the derivative in 
s, and then dividing by ^£^(s). This division is legitimate because < 0 
for nondegenerate g. Iterating this process on (1301) as many times as we wish 
shows that (a, b, c, d) = (o', c', d'). 

Bijective continuous maps between compact Hausdorff spaces are homeo- 
morphisms. 

Now, obtain U^V as in Proposition 12.3.61 Define 

ai = UoSo + Uig + U 2 g * g + U^g * g* g (31) 

and 

02 = VoSo + Vig + V 2 g * g + V^g * g* g. (32) 

We assume without loss of generality that ai,a 2 are directing measures. This 
way, © 1 , ©2 are the pushforwards of U, V via the above homeomorphism. Since 
©i ,©2 are the distributions of ai,Q ;2 by Remark |2. 0.91 we have that Oi 02 
and ©1 7 ^ © 2 . However, the random Laplace transform of Oi is 

= (33) 

and the Laplace transform of 02 is 

= (34) 

Vectors of the form s) are a subset of the image of C4. Thus, 

Vs, Qfi and 02 have random Laplace transforms evaluated at s that have the 
same distribution. Thus, by Lemma r2.0.11l it follows that L is not good. □ 
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2.5 Another Generalization of the Fonr-Value Case 

The primary purpose of this subsection is to prepare for comparisons and analo¬ 
gies with material from Subsection 13.21 and to expose some new techniques that 
are useful in proving results showing the relationship between arithmetic and 
algebraic dependences versus uniqueness results. The techniques themselves are 
not logical prerequisites for material in the sequel. 

We may instead replace the role of independent sums by regular sums of the 
random variable with itself. So we regard 0,1, 2, 3 as the sum of 0,1, 2, 3 copies 
of 1. If instead of 1, we use an arbitrary nonnegative random variable, we arrive 
at the following generalization. 

Proposition 2.5.1. Let be such that is a rational function in s, 

and letT ^ 0 be a random variable with distribution fi. Fix N > 3. Let L be the 
convex combinations of the distributions of OT, IT, 2T,..., NT. i.e. L <Z P'^ is 
the set of probability measures that have Laplace transform of the form 


Then L is not good. 


N 

'^hjC^{js). 


i=o 


(35) 


Independent sums of exponential random variables give rational Laplace 
transforms, for example. 


Proof. It suffices to handle the case N = 3. Assume that T^(s) = p{s)/q{s) 
with p, q polynomials sharing no common factor, and q having no zeros in [ 0 , oo). 
We seek a homogeneous polynomial r 7 ^ 0 of 3 variables for which 


^ / pjls) _ pjOs) p{2s) _ pjOs) p{3s) _ p(0s) \ ^ 
^V 9 (ls) 9 ( 0 s)’q( 2 s) q(0s)’q(3s) q(30) J 

This is equivalent to 


(36) 


r(p(ls)q(0s)q(2s)q(3s) - p(0s)q(ls)q(2s)q(3s), p(2s)q(0s)q(ls)q(3s)- 
p(0s)q(ls)g(2s)q(3s),p(3s)q(0s)q(ls)q(2s) - p(0s)q(ls)q(2s)q(3s)) = 0 (37) 

Let us say that p has degree n > 0, q has degree m > 0, and r has degree I > 0. 
The space of polynomials in s of degree at most I (3m -I- n) has dimension linear 
in Z as a vector space over K. whereas the space of polynomials in 3 variables 
that are homogeneous, of degree I is quadratic in 1. Therefore, there exists I 
large enough such that the assignment of homogeneous degree I polynomials in 
3 variables to polynomials of degree at most /(3m -I- n) given by 


r M- r{p{ls)q{0s)q{2s)q{3s) — p{0s)q{ls)q{2s)q{3s),p{2s)q{0s)q{ls)q{3s) — 

p{0s)q{ls)q{2s)qi3s),pi3s)q{0s)q{ls)q{2s) - p{0s)qils)q(2s)q{3s)) 

(38) 
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has nontrivial kernel. 

Thus we have a nonzero homogeneous polynomial r for which r(£^(ls) — 
£^( 0 s), £^( 2 s) - £^( 0 s), £^(3s) - £^( 0 s)) = 0 . 

Now, we use Lemma B.3.51 to find W = {Wi,W 2 ,W'i) Z = {Zi,Z 2 ,Z^) 
bounded random vectors for which Vs > 0 we have 


(/:^(ls) - £^(0s), C^{2s) - £^(0s), /:^(3s) - £^(0s)) • W = 

(£^(ls) - £^(0s), £^(2s) - £^(0s), £^(3s) - £^(0s)) ■ Z. (39) 

We then find C compact such that W, V are both C-valued, and o 7 ^ 0, 
6 G such that aC + 6 C Tg := {(a, &, c)|a + 6 + c < 1, a, &, c > 0}. This is 
possible because C is compact and Tg has nonempty interior. Thus, we may 
assume that W, Z were Tg-valued to begin with. We now define U, V via 


Uo = l-Ui-U2-U3 
Ui = Wi 
U 2 = W 2 
U3 = W3 

U=(Uo,Ui,U2,U3), 

Thus U ^dV and Vs > 0, we have 


Vb = 1 — .^1 — .^2 — -2^3 
Id =^i 
F2 = ^2 
Vb = ^3 

V = {Vo,V3,V2,V3). (40) 


(£^(0s),£^(ls),£^(2s),£^(3s)) • U =d 

(£^(0s),£^(ls),£^(2s),£^(3s)) • F. (41) 

Let /ife denote the probability distribution of kT. We define ai = f/o/io + t/i/ri + 
1 / 21*2 + I/ 3 M 3 and a 2 = VofJ-o + Vifii + ¥ 2^12 + Vb/rg which are L-valued. Without 
loss of generality, we assume ai and 02 are directing measures. 

Since T 7 I: 0, we have that all of the are distinct, nondegenerate, and 
therefore have Laplace transforms with derivatives that are never 0. We aim 
to show that is homeomorphic to L through the map (a, b, c, d) 1 —>■ a/ro + 
5/ii + c ^2 + d^ 3 . This is surjective. Also, it is injective because if there are 
(a, b, c, d), (a', 6 ', c', d', ) such that a/io+ 6 /ii+c/i 2 +d/J .3 = a'^o+b'fii + c' ^2 + d'fis 
then we may take Laplace transforms to obtain Vs > 0 


a£;_,(0s) + b£fj,{ls) + c£fj,{2s) + d£^(3s) = 

a'£^(0s) + b'£f,{ls) + c'£^{2s) + d'£^{3s). (42) 

We may take the derivative of this relation k times, then take s j. 0, then divide 
by [^£^](0). Again, this operation shows us that {a,b,c,d) = {a',b',c', d'). 
Continuous bijections between compact Hausdorff spaces are always homeo- 
morphisms. 


15 




Therefore, U V implies that ai a 2 and 0i ^ 02 - Also, Vs > 
0, Cai (s) =d (s)- This is because the left side is the left side of (ITO and the 
right side is the right side of m- This suffices by Lemma [2.0.Ill 

□ 

The answer to the Aldous problem actually changes despite the fact that the 
arithmetic dependences in some sense still remain. To show this, roughly speak¬ 
ing we will use a very transcendental Laplace transform to make the arithmetic 
dependences irrelevant. 

Proposition 2.5.2. Let T be Poisson distributed with parameter A. Let N > 1. 
Let pt be the distribution ofT, and define p,o,/ri,^ 2 , • • ■ ,h'N as before. Define L 
as in Provosition \2.5.T[ Then L is good. 

Proof. We will argue for TV = 3, with the general case being similar. Let 
jC{s) = e^^‘^ denote the Laplace transform of pi. Because we already 
know that T 4 is homeomorphic to L in the natural way (see the last proof), 
it suffices to show that there cannot be any U = {Uo,Ui,U 2 ,Ufi) V = 
(Vb, Pi, V 2 , P 3 ) defined on T 4 for which Vs > 0, (£(0s), £(ls), £(2s), £(3s)) -17 = 
(£(0s), £(ls), £(2s), £(3s)) • V. We will in fact show that there is no ho¬ 
mogeneous polynomial other than 0 that vanishes on the image of the curve 
(£(0s), £(ls), £(2s), £(3s)) G defined for s > 0. Suppose that r 7 ^ 0 is 
such a homogeneous polynomial of degree I, say. Order the set Mi of monic 
monomials of total degree I in 4 variables by ordering lexicographically on the 
exponents, with the fourth variable taking highest priority, then the third, sec¬ 
ond, then first. This is a total ordering. Write Ou, for the coefficient of any monic 
monomial w in r. Find the largest monic monomial with a nonzero coefficient 
in r. Call this monomial to(xo, cci,X 2 ,Xa). Then we have 


r{xo,xi,X 2 , X 3 ) = amm{xo,xi,X 2 , xfi) + ^ aww{xD,xi,X 2 ,xz) (43) 


with Om 0. 

We have Vs > 0 


r(£(0s), £(ls), £(2s), £(3s)) = 0 (44) 

so by the theorem of complex analysis asserting the equality of holomorphic 
functions defined on the same connected open domain, agreeing on a set with 
an accumulation point within this domain, (1441) holds also for s < 0. The term 
of r(£(0s), £(ls), £(2s), £(3s)) corresponding to m goes to 00 as s ^ —00 faster 
than any of the other terms, so the coefficient Om is 0, contradiction. □ 

2.6 The Normal Case 

The normal case is another case of significance to the next section on the con¬ 
tinuous time analog of the present problem. 


16 






Lemma 2.6.1. Let N be the collection of normal distributions, including the 
degenerate ones. For all fj. € N let =mean of g, and let V{^i) = variance 

of g,. Then the map (M, V) : iV —>■ R x [0, oo) is a homeomorphism, hence 
measurable isomorphism. 

Proof. This follows from convergence of types. □ 

Remark 2.6.2. Let Q be a mixing measure supported in N. Since 0 is then 
a probability measure on N, we can view M, V as random variables giving the 
(random) mean and variance of an element of N drawn with prior distribu¬ 
tion 0. Then the joint distribution of the corresponding exchangeable sequence 
X is given by =d (A + R^/W(0, where the entire family 

{A/"(0, l)i, A/'(0, 1 ) 2 , • ■ •, R)} is independent (but the notation indicates A,B 

may not be independent), {A, B) (M, V), and Af{0, 1)^ is normal with mean 
0 and variance 1. 

See, for instance, p.29 of [I] regarding this remark. 

We highlight in the remark that the distribution of (M, y) is calculated 
relative to 0, and that it is necessary to use {A, B) instead of (M, V) when 
we deal with the independent normals because these normals and {A, B) are 
constructed on the same probability space. 

We already specified that X, Y corresponds to 0i, 02 and ai, 02 via Remark 
12.0.91 For this subsection, when 0i, 02 are supported on N, we will use (Mi, Vi) 
to indicate {M,V) defined on the probability space (fV, 0i) and (M 2 ,V 2 ) to 
indicate (M, V) defined on the probability space {N, 02). 

We have the following transform inversion fact. 

Lemma 2.6.3. Suppose /i, v be probability measures on R. x [0, 00 ) such that 
Vt, s G M X [0, 00 ) we have 

f e^*^-^ydp{x,y)= [ e^*^-^ydv{x,y). (45) 

</rx[0,oo) J'Rx[0,cio) 

Then y, = v. 

Notice that N is not a subset of The author is uncertain if N is good 
or not, which seems to rely on a generalization of Muntz’s Theorem (see m) 
which would include the sequence of points = 1/n in the role of the values 
of the parameter at which the Laplace transform is known a priori. However, 
what is true is the following. 

Proposition 2.6.4. Let 0i,02 supported in N be given. Suppose that Vi,V 2 
have finite MGF in some neighborhood around 0, and that Vn > 0, Sn =d Tn. 
Then 0i = 02. 

Proof. Let {A, B), {A',B') have the same distributions as (Mi, Vi), (M 2 , V 2 ) re¬ 
spectively with the three random vectors/variables {A,B), {A',B'),M{Q, 1) all 
independent. From Sn =d Tn we learn that Vn > 0, nA + 1) =d 
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nA' + (ni?')^/^A/"(0,1) Computing the characteristic function of both sides re¬ 
veals that Vn > 0, t G ffi. 

or equivalently Vn > 0, f G M 

=E[e*‘^'-^]. (47) 

Looking at (ITfll for fixed t and varying n, it follows that the convergence of 
the MGF in a neighborhood of 0 is precisely what is needed to be able to use 
complex analysis to conclude that for each fixed t, we have that Vs > 0 

E[gitA-sS] ^ gjgitA'-sB'j 

Particularly, we are using the fact that holomorphic functions defined on a 
common connected open domain, agreeing on a set with a limit point in the 
domain must be equal. Namely, this limit point would be s = 0 regardless of 
which t was fixed. The MGF hypothesis is what allows s = 0 to be in the 
(interior of the) domain of these transforms. 

Then, by Lemma [2T6]3] it follows that {A, B) =d {A', B') so that (Mi, Vi) =d 
(M 2 , V 2 ) from which it follows by Lemma [2.6.11 that 0i = 02. 

□ 


3 Continuous Time Exchangeability Problem 

We could view the questions answered in the last section from the perspective 
of iS'„,r„. These are mixtures of partial sums of iid sequences. From this point 
of view, it is natural to consider mixtures of Levy Processes, which are the 
continuous time analog. Recall that a Levy process is an independent stationary 
increments process that is continuous in probability and starts at 0. We will 
use the notation St,Tt for mixtures of Levy processes, after they are defined, in 
order to reflect this analogy. In order to aid our discussion, we recall: 

Lemma 3.0.5 (Levy Khintchine Formula). Let Z = {Zt)t>o be a Levy pro¬ 
cess. Then there exist unique I3,a‘^ such that v is a finite measure on R. with 
*^({0}) = 0, cr^ > 0, /3 G M and Vu G R, t > 0 we have 


E[e™^‘] 


= exp 





iux \ 

l + cc2 j 


l-\- 



(49) 

Furthermore, every /3 G R, cr^ > 0, b a finite measure on R with no atom at 0 
corresponds to a unique (up to distributional equality) Levy process with char¬ 
acteristic function given by ((451) . 


We would now like to define the notion of a mixture of Levy processes. For 
technical reasons, we downplay the role of exchangeability. For the moment. 


18 









we also focus on characteristic functions in order to be able to state the defini¬ 
tion before worrying about measurability concerns associated with generalizing 
®. Then we will show how the definitions we make are directly analogous to 
those of the previous section. These claims are mostly for checking intuition 
about what a mixture of Levy Processes should mean, but they will also be 
used in Subsection 13.21 (They will not be featured as prominently in the next 
subsection.) 

Given parameters ,5 G R, cr^ > 0,finite measure on R. with no atom at 0, 
we will use the notation 4’p,rT'^ n-variate characteristic function 

of (2'tj,..., Zt^) where the Levy process Zt is chosen for parameters /3, cr^, v. 
We will use Mq to denote the collection of nonnegative finite measures on R 
that vanish at {0}. From now on, we will always implicitly assume (/3 ,ct^,z^) G 

Rx [0, oo)xMq . We will use „ := ^{Zt)t>o^ (P) to mean the pushforward 

of P (the probability measure on whichever space the process under study is 
defined on) via the Levy process Z = {Zt)t>Q, i.e. the (joint) distribution of the 
Levy Process. 

Definition 3.0.6. A mixture of Levy processes is S = {St)t>o such that 
there exist a probability measure 0 on R x [0, oo) x for which the joint char¬ 
acteristic function of S is specified by\/n > 1,VO < G < • ■ • < tn,ui,... ,Un G R 
we have 



_t^{ui,...,Un)dQ{P,a'^,iy) (50) 


We call 0 the mixing measure. 

By using discrete time De Finetti, it follows that in this case 0 is uniquely 
determined by the distribution of S. 

In the discrete time case, we were able to obtain a discrete time process 
(namely S'„) from the mixing measure 0. It is reasonable to ask if the same can 
be done here. 

Lemma 3.0.7. Given a probability measure 0 on R x [0,oo) x Mq , there is 
a unique (up to joint distributional equality) stochastic process S = {St)t>o for 
which 0 is the mixing measure. 

Proof. First we check existence. Restrict to finite dimensional distributions, us¬ 
ing (1501) to define these finite dimensional distributions. Then check Kolmogorov 
consistency and use Kolmogorov extension theorem. 

The uniqueness up to distributional equality is built into the definition of 
mixture of Levy processes. □ 

From Levy continuity, stationarity of increments and the fact that distribu¬ 
tional convergence to 0 is the same as in probability convergence to 0, it follows 
that all mixtures of Levy processes are continuous in probability. 
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We will use the following notation: S = {St)t>o,T = {Tt)t>o will be the 
mixture of Levy processes, with mixing measures 0i, 02- We will have no need 
for trying to define some analog of ai, 02 in this context. 

The set I of infinitely divisible distributions is closed in P(M), hence mea¬ 
surable. 

We regard (PI) as specifying a bijection between K. x [0, 00 ) x Mq and 
the collection £ of distributions of Levy processes ( {Xt)t>o ) (P). So £ C 


£ is given the smallest a algebra so that passage from an element of 
£ to its marginals is measurable from £ to I. That is, Vto > 0, (Xt)(>Q(P) >->• 
Xj* (P) should be measurable. It follows from standard proofs of (l4^ that the 
bijection specified by (1491) is a measurable isomorphism. There is also a natural 

measurable isomorphism between £ and I via (P) 1 —>■ Xj^(P). 

Because P(R) with vague convergence is a Polish space, and X is closed in 
P(R), we have that £ is a standard Borel space. Therefore, our definition of a 
mixture of Levy processes is entirely parallel to the notion of mixture from the 
last section. 

Because of these observations, it is sensible to state and we have proven the 
following: 

Lemma 3.0.8. S is a mixture of Levy processes if and only if there exists 0 a 
probability measure on £ for which \/A C product measurable, 


eA)= [ 7(A)d0(7) 
J s. 


if and only if there exists 0 a probability measure on ] 
\/A C product measurable, 


(51) 

. X [0, 00 ) X Mq for which 


F{SeA)= [ Lp^,2^,,{A)dQ{l3,a\iy). 

JRx [0 ,oo)xMq 


(52) 


In any case, 0 is unique. 


Thus, when speaking of 0 being a mixing measure or related topics, we 
will freely use these identifications. For example, we will allow ourselves to 
say “mixtures of Brownian motions”. Also, we will no longer use the notation 
R X [0, 00 ) X Mq and will use £ instead. These identifications needed to be 
measurable in order for it to be possible to discuss mixtures using any of the de¬ 
scriptions, reconciling with the intuition that Levy processes are truly the same 
as their Levy Khintchine parameters and as infinitely divisible distributions. 

The interested reader can combine what we have done so far with to 
see that being a mixture of Levy processes is equivalent to being continuous in 
probability and satisfying a certain kind of exchangeable increments hypothesis. 

Again, we will use a notion of goodness to abbreviate our discussion. 

Definition 3.0.9. We will say that a measurable subset L of £ is good if 
whenever 0i, 02 are concentrated on L and \/t > 0, St =d Tt we have S =d T. 
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3.1 The Case of Brownian Motions 

Recall that a Brownian motion is a Gaussian Levy process, and can have drift 
and can proceed at any positive rate. (i.e. we only require that the variance at 
t = 1 is positive.) We denote the space of Brownian motions by BM C £. BM 
corresponds to the requirement that the v component of the Levy Khintchine 
formula is 0. We claim that 

Proposition 3.1.1. BM is good. 

Proof. Using dSOl) for one value of t at a time, we have Vu S K, t > 0 


/ exp{mt/3 — tu^a^ /2}dQi{l3, a, 0) = 

1rx[0.oo)x{0} 

f exp{wt/3 — tM^(T^/2}d02(/3, CT, 0). (53) 

^Rx [0,oo) X {0} 

Lemma 12.6.31 now finishes the proof. 

□ 

Notice that in the discrete time normal case, we had the last equation only 
for t = Ijn but now we have it for all t > 0, which is important in eliminating 
the need for assumptions about convergence of MGFs. Because the discrete set 
of rationally related numbers 1/n, arising via application of r 1/r to N in the 
proof of Proposition [2)631 is replaced with a continuum in the above proof, this 
can be thought of as a destruction of the arithmetic structure. As promised, 
this is a case in which passage to the continuous time problem implies not only 
the additional information of infinite divisibility, but crucially the observations 
at a continuum of times rather than only a discrete set. 


3.2 A Poisson-Flavored Case 

All functions of u of the form 

exply - l)d/i(a;)| (54) 

are characteristic functions of infinitely divisible distributions, as long as /x is a 
finite nonnegative Borel measure. This can be seen by taking a vague limit of 
sums of independent Poisson Processes with various rates and jump sizes. 

Gall LISPP the subset of £ determined by (l54l) . (Here LISPP stands for 
“limits of independent sums of Poisson Processes.”) We may think of the el¬ 
ements of LISPP as “independent integrals” of Poisson Processes, which is a 
different notion than a mixture of Poisson Processes and also different from 
compound Poisson processes. By a calculation, we have 

Lemma 3.2.1. LISPP is measurable in £ beeause it is actually determined by 
the conditions /r dv{x) < oo,/3 = J^^diy{x). 
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It follows from the description of LISPP above that /j, is uniquely determined 
by the infinitely divisible distribution. Moreover, 

(Xt)r>o(P) e LISPP ^ HG M+(R) (55) 

is a measurable isomorphism, which is defined on LISPP. Therefore, we may 
identify each element of LISPP with a nonnegative finite measure on K via this 
correspondence. Also, if LISPP'*’ is the subset of LISPP corresponding to /r 
supported in [0, oo) (i.e. we only allow positive jump size Poisson Processes to 
enter the independent integral), then LISPP’*' is of course measurable in LISPP. 

Since (I54|) specifies the distribution of a nonnegative infinitely divisible dis¬ 
tribution for elements of LISPP^, the Laplace transform can be calculated by 
analytic continuation; V/x finite Borel measure on [0, oo), we have the function 

exp < f — l)dfj,{x) > (56) 

[J[0,oo} J 

of s is the Laplace transform of a member of LISPP’*’, and moreover these are 
the only Laplace transforms of members of LISPP’*’. 

We will also refer to LISPPi,LISPP)*’ to denote the requirement that /i be 
a probability measure. These are also measurable subsets of LISPP. 

If 0 is concentrated on LISPP, LISPP^, LISPPi or LISPP)*’, then fi can be 
regarded as a random measure defined on LISPP, LISPP^, LISPPi or LISPP)*’. 
We now show how the last section on the discrete problem can be embedded 
into the current problem. 

Lemma 3.2.2. Let L be a measurable subset of LISPP^. Then L is good if and 
only */V0i,02 concentrated on L, we have 

Vs >0,/:^,(s) =rf/:^,(s) (57) 

implies 

01 =d 02. (58) 

Here, we regard g, g, as a mapp from LISPPi to P([0, oo)), and we regard 
01,02 as giving the structure of a probability space to LISPP^ in two different 
ways, so we require that /xi,/X 2 are random probability measures with the same 
distribution as fj, under 0i and 02 respectively. 

Therefore, even though there is no ideological connection between the mixing 
measure of the last section and the measures fi from this section which are similar 
to the Levy Khintchine measure, at the level of the mathematical formalisms 
the problems are related. 

Proof. Observe first that if S,T are mixtures from L, then \/t > 0, St =d Tt if 
and only if Vt > 0, s > 0, n > 0 we have 
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E[exp{nt / (e — l)c?/^i(x)}] = E[exp{nt j (e 


— SX 


l)dfi2{x)}] (59) 



by using dSOl) for one value of t at a time. Then we know that is equivalent 
to Vt > 0, s > 0, n > 0 


E[exp{t f (e — l)d^i(a:)}"] = E[exp{t f (e — l)d^ 2 (a;)}"] (60) 


^[0,oo) ^[0,oo) 

which, by the bounded moment problem is equivalent to Vt > 0, s > 0 



(61) 


But this last statement is equivalent to Vt > 0, s > 0 



(62) 


which is the same as Vs > 0 



(63) 


and therefore also the same as Vs > 0 



(64) 


because are always probability measures. 

We have that S =dT ii and only if 0i = 02. 


□ 


Remark 3.2.3. Notice how it did not matter that we made a continuum of 
observations because the nonnegativity assumption LISPP^ allowed us to use 
the Laplace transform. Since, when restricted to real arguments, exponentiation 
is invertible, we were able to cancel an exponentiation and then cancel the t. 
Therefore, a measurable subset LISPP^, when viewed as a subset of I, is good 
if and only if it is good as in the last section. That is, to tell apart two mixtures of 
LISPPts, we only need to observe at natural number times. This manipulation 
was not available in the BM case because there we were dealing with complex 
exponentiation, which also forbids the use of the bounded moment problem above. 

For the next result, MA C P{M.) measurable, we use 


LISPP(A) := {(Xt):>o(P) e LISPP|/i G A} 


(65) 
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where /i is the measure in (IMl) giving the characteristic function of Xi. For 
example, LISPPF{o,i, 2 , 3 } denotes the collection of Levy processes that can be 
written as an independent sum of of a Poisson Process of rate 0 and jump size 
Xq, one of rate 1 and jump size xi, one of rate 2 and jump size X 2 , and one of 
rate 3 and jump size 2:3 such that (xq, a:i,X 2 , 2 : 3 ) S T 4 . Since we will always 
use A such that all measures in A are supported in [0,oo), our LISPP( 2 l) will 
always be a subset of LlSPPj*' so we will be able to use the above lemma. 

The fact that the continuum of observations does not destroy any arithmetic 
structure suggests that the situation with LlSPPj^ will be more nuanced than 
the situation with BM, where uniqueness of S = (St)t>o held without further 
conditions. Indeed, we now know that the variety of possibilities of goodness is 
at least as much as that of the discrete time problem: 

Theorem 3.2.4. Let A C be measurable, and consist only of compactly 
supported measures. Then A is good (in the only sense that is available, i.e. 
from the discrete time problem) iff LISPP{A) is good (in either equivalently the 
sense of the present section or the last when LISPP{A) is viewed as a subset of 
I CP(R)). 

Proof. This is a consequence of Lemma 13.2.21 □ 

Remark 3.2.5. The upshot of this theorem is that any set of probability mea¬ 
sures that is good when in the role of the allowed eomponents of the mixture 
are also good when in the role of p,. One could iterate this. If A is good, then 
LISPP{A) is good, then LISPP{LISPP{A)) is good and so on. After all, thanks 
to the fact that knowing each Sn is enough, as long as we only concern ourselves 
with mixtures of Levy processes, there is no difference between the continuous 
time and discrete time problems. 

Corollary 3.2.6. Let be probability measures on [0,oo). Let C he 

the convex hull of {h'i,i' 2 ,r' 3 }. Then LISPP{C) is good. Also, if A is a dis¬ 
crete, countable set of real numbers that is linearly independent over Q then 
LISPP{Fa) is good. LISPP{F[q 12 , 3 }) is not good. 

Remark 3.2.7. Of course, most of the other results of the last section could 
be generalized just as easily, but they are not as meaningful as the ones listed 
above in the context of mixtures of Levy processes. 

Notice the comparison with Remark l2.1.41 which is a reasonable comparison 
because we already saw that in this case knowing all St is no different than 
knowing only the Sn. In Remark 12.1.41 we were concerned with mixtures of 
Poissons (with jump size 1 and rate A) and we were mixing over different rates. 
There, uniqueness of Sn was true, which can also be deduced from our present 
machinery by applying Theorem 13. 2. 41 to the good set A = {5x\x e [0, 00 )}. 

In general, uniqueness fails in the present setting for even jump sizes re¬ 
stricted to {0,1, 2, 3}, because we allow the rates to vary as long as they add up 
to 1. Both this and Remark 12.1.41 are different than the situation in Proposition 
12.5.21 where the rate was fixed, but the jump size was allowed to be 0,1, 2, or 3 
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and we were allowed to take convex combinations of these distributions before 
mixing them. 

Another different situation occured in the context of Proposition 12.4.11 ap¬ 
plied to Poisson distributions, where the jump size was fixed at 1, the rate was 
fixed at A, but we allowed independent sums and convex combinations to come 
in before we take the mixture. 

These show that goodness is not really a property of a type of distribution 
only, but also the specifics of how the class is assembled. 

4 A Class of Uniqueness Problems 

From now on we will use 



( 66 ) 


to mean the MGF (at s G R) of a probability measure /i on R. Here, n may be 
random or deterministic. We will often make assumptions about finiteness of 
the MGF, which we will state as needed. We also use 



(67) 


to mean the characteristic function (at t G R) of a probability measure ^ on R. 
Here, /i may be random or deterministic. 

In this section, we will discuss a variety of uniqueness problems regarding 
determining the distribution of a random probability measure from limited in¬ 
formation. These problems will all run parallel to classical versions of various 
uniqueness results. 

Definition 4.0.8. Given a probability measure p defined on R, let pk '■= 
J^x^dp{x) denote the moment of order k of p, when it exists. Define € to be the 
collection of p € P(R) that obey the Carleman condition that all the moments 
exist, are finite, and ^^6 convention that 1/0 = c». Let 


M<oo denote the collection of p € P(R) with finite MGF in some neighborhood 
ofO. 


Sometimes p will denote a random measure. 

We will sometimes make the assumption that the random measure p is uni¬ 
formly bounded a priori. This means there exists M > 0 such that p is a.s. 
supported in [—M,M]. 

We will use the notation pk := j^x^dp(x) to indicate the (random) moment 
of order k for p, wherever this is defined. 

For any of the classes in Definition l4.0.8l or for P+, we will say p. is a member 
of that class if this holds a.s. Observe that all of these conditions are measurable. 
Notice this implies no uniformity, for instance each sample from p G M^ao may 
correspond to a different open interval about which the MGF is finite. 
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For now, let us assume that fj, is deterministic and state the classical unique¬ 
ness results for comparison: 

Proposition 4.0.9. Let /i, v be deterministic probability measures on R. Then 
pL = v provided any of the following hold: 

1. (j>fj. = (fi, 

2. pt,v € and 

3. pi,v € M<oo and Mf^ = M,^. 

4- p.,v & € and Vfc >0,p,k = Vk 

Let Sf), SC, SM denote respectively the collections of functions that arise 
from some pL as in case (1), (2), (3), with the value -l-oo possible in case (3). 
Let SMOM denote the collection of sequences of real numbers that arise as 
the moments of some p, as in case (4), which we regard as a function of /c > 0. 
On each of these spaces of functions, we use the Borel a algebra generated by 
the evaluation maps. Then the content of the last theorem is that p ^ (j)p, is 
a bijection from P{R) to S(j), ^ is a bijection from to SC, p 

is a bijection from the M<oo to SAi, and p i-^- {pk)k>o is a bijection from £ 
to SMOM. Observe that all of these maps are measurable isomorphisms. It 
follows that 

Proposition 4.0.10. Let p,v he random probability measures. Then p =d v 
provided any of the following hold: 

L =d {4>v{t))t^K. 

2. p, k' £ P~^ and (l^/i(s))s>o —d (Ci/(s))s>o. 

3. p,v & M<oo and (AI^(s))(s))sgR =d (A4^(s))sgR (which may he valued 
oo for some s and some sample points.) 

4 . p,v and {pk)k>o =d {vk)k>o 

To summarize, under suitable conditions, knowing the characteristic func¬ 
tion, laplace transform, MGF, or moments jointly tells us the joint distribution 
of a random measure. It is natural to ask what happens when this type of 
information is only known marginally. (We call these the marginal problems, 
as opposed to joint.) Actually, we can already provide an answer to 2 of these 
problems. One counterexample that is uniformly bounded will simultaneously 
witness the failure of both statements. 

Theorem 4.0.11. There exist p, v uniformly bounded random measures in P^ 
such that p =f^d V while yet Vs > 0, C^{s) =d C,^{s) and Vs € R., M.fi{s) =d 
M^s). 
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Proof. By Proposition l2.3.61 we obtain random variables U,V S T 4 with U ^dV 
such that Vy G R, 04 ( 1 /) • U =d Ci{y) ■ V. Define random probability measures 
/i, ly supported in {0,1, 2, 3} via /i = Uq'^o + + U 262 + U 363 and ly = Vb^o + 

Vi5i + ¥262 + VzSz- Upon calculating the transforms of these random measures, 
the fact that My G R, 04 ( 1 /) ■ U =d 04 ( 2 /) • V translates into the fact that the (3’) 
holds, and thus that ( 2 ’) does as well. □ 

It is not difficult to believe that the moment problem will require a different 
argument to handle in the marginal case, but it may be surprising that the char¬ 
acteristic function marginal problem could not be handled in the above proof. 
That is because the characteristic function is a complex valued random variable. 
Indeed, we have been avoiding this situation partly because the methods of the 
last two sections cannot deal with complex valued uniqueness problems, and 
partly because we did not have to since the problem had already been solved in 
the negative, and special subclasses of interest already were nonnegative any¬ 
way. However, here we arrive at a case where the signed question has not been 
solved yet, and our methods with some adjustment will actually be applicable. 
We will present a proof of nonuniqueness for the marginal characteristic function 
case in Subsection O From this proof, it will be plausible that the arithmetic 
dependences of the allowed support set is the culprit, because it reduces the 
analysis to one of polynomials, for which we will be able to use Lemma [2.3.51 

In Subsection 14.21 we will present a proof of nonuniqueness in the moment 
marginal case, even if the restriction is made to a finite support set, hence to the 
uniformly bounded hypothesis. In Subsection l4.3l we will show how the relevant 
arithmetic structure from Subsection 14.21 was multiplicative, and that therefore 
if the set of allowed values consists of coprime numbers, then uniqueness of the 
distribution of a random measure with a given set of moments does hold. 

We display our results concerning random uniqueness problems in the follow¬ 
ing table. We remind the reader that the assumption for the MGF case is finite 
MGF in a neighborhood around 0 (a.s.), the assumption for Laplace transform 
is nonnegativity, there are no assumptions for characteristic function, and the 
Carleman condition is assumed to hold (a.s.) for the moment problem. The 
entries “yes” and “no” refer to whether or not uniqueness holds. All answers 


come with a uniformly bounded (pair of) counterexamples, 

joint marginal 

MGF 

yes 

no 

Nonnegative Laplace Transform 

yes 

no 

Characteristic Function 

yes 

no 

Moment Problem 

yes 

no 


4.1 Uniqueness Fails for Characteristic Function Problem 

In this subsection, we will use z = x + iy to denote a complex number. We 
define Vn > 0, Pn{x, y) = ^(z^) and Qn{x, y) = 3 ( 2 "’) which are homogeneous 
polynomials in the two variables x,y oi degree n. By default, our polynomials 


27 







will be defined on a Euclidean space where d > 1 is the number of variables 
of the polynomial. First we need a lemma. 

Lemma 4.1.1. For N,l € N large enough, there exists p, a nonzero degree I 
homogeneous polynomial in N variables such that \/s,t,x,y G R we have 


p{sPo{x,y) +tQo{x,y),... ,sPN-i{x,y) +tQN-i{x,y)) = 0. (68) 

Proof. We first note that if some N, I satisfies the conditions of the lemma, then 
all greater pairs would work as well, so our use of the phrase “large enough” is 
justified. We now only need to find one pair TV, I for which (IS51) holds. 

For any I, N, let Si^n denote the real vector space of polynomials in s, t, x, y 
of degree at most IN and let denote the real vector space of degree I 
homogeneous polynomials in N (commuting) variables. 

Observe that 

p{sPo{x,y) + tQo{x,y),.. .,sPN-i{x,y) + tQN-i{x,y)) (69) 

defines a polynomial (not necessarily homogeneous) of degree at most IN in the 
4 variables s,t,x,y. Define the corresponding evaluation map 

$ : Ti,n ^ Si,N (70) 

via 


$(p) = p{sPo{x,y) + tQo{x,y),... ,sPN-i{x,y) +tQN-i{x,y)). (71) 

Observe that $ is linear. The dimension of its codomain is X]j=o ('^ 3 ^) — 
{IN + 4)"^. If we restrict to I = N then the dimension of the domain is 
Therefore, for = Z large enough, the kernel of $ is nontrivial. 

□ 

As before, we will construct a precursor to the counterexample by construct¬ 
ing merely bounded random vectors with the desired property, and then we will 
adjust them so as to turn them into random probability vectors. The follow¬ 
ing can be thought of as the complex analog of a part of the argument used 
in the proof of Proposition 12.3.61 The equality in distributions are meant for 
complex-valued random variables. 

Lemma 4.1.2. For N large enough, there exist 


U = (t/o,..., Un-i 

II 

1 

(72) 

bounded random vectors taking values 

in for which Vz € C we have 


7V-1 

A^-l 


E 

=, ^ z‘V, 

(73) 

j=0 

j=o 



while yet U ^dV 
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Proof. Take N large enough so that the set 


{{sPo{x,y) + tQo{x,y),... ,sPN-i{x,y) + tQN-iix,y)) G R^\s,t,x,y € R} 

(74) 

is contained in a projective variety. By Lemnia r2.3.5l we may find U, V bounded 
random vectors so that Vs, t, x, y we have 


{sPo{x,y) + tQo{x,y),..., sPN-i{x,y) + tQN-iix,y)) ■ U =d 

{sPo{x,y) + tQo{x,y),.. .,sPN-i{x,y) + tQN-i{x,y)) ■ V (75) 

while yet U j^dV. 

By the Cramer Wold device, we have that Vcc, y G R, the R^-valued random 
vectors 


{{Po{x,y),.. 

. .,PN-i{x,y)) ■ 

U,{Qo{x,y),. 

■ ■, Qn- 

.i{x,y)) ■ U) 

(76) 

{{Po{x,y),.. 

■ ■,PN-i{x,y)) ' 

■V,{Qo{x,y),.. 

.., Qn- 

.i{x,y)) ■ V) 

(77) 


have the same distribution. But by real isomorphism of R^ with C, this is the 
same as saying that 

{Po{x,y),...,PN-iix,y)) -U + i{{Qo{x,y),... ,QN-iix - y)) ■ U) =d 

{Poix,y),.. .,PN-iix,y)) ■ V + i((Qo(x,y),... ,Qjv-i(x,y)) • V) (78) 
But by the definition of the P„, Qn this is the same as saying Vz G C we have 

(z°,...,z^-^)-U=d(z°,...,z^-^)-V (79) 

as complex-valued random variables. Thus, U and V have the required proper¬ 
ties. □ 

Lemma 4.1.3. There is N' large enough so that there exist 

U' = (t/^,..., C/^_i) y' = (Fo', ■ ■ •, V^-i), (80) 

both valued in 


N'-l 


Tn' ■■= {(a^o, • ■ .,XN'-i)\'^j : 0 < j < - 1, > 0, ^ Xj = 1}, (81) 

3=0 

for which Vz £ C 


7V'-1 N'-l 

E =d E 

3=0 3=0 


(82) 
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Proof. Take N,U,V from the last lemma. Set N' = N + 1. Notice that (1731) 
still holds if we rescale or translate U, V in the same way. Consider H := 
{(xq, ... ,XAr-i)|l >Xq>---> xn -1 > 0}. Since H has nonempty interior, we 
may take U,V G H without loss of generality. Then when we define U-i = 1 = 
V-i, Un = 0 = Vat, and Vj : 0 < j < N, t/j = Uj-i — Uj,V- = Vj-i —Vj, observe 
that U',V' are valued. Furthermore, IP V. A calculation shows that 
we have V 2 ; G C 


(z®,..., • {U[ + • • • + U'j^, U 2 + ■ ■ • + U'f ^,..., U'f^) —d 

(0°,..., 0^-1). (F/ + • • • + F 2 ' + • • • + ..., Vf,). (83) 

From this it follows that 

(z°)C/{ + (z° + z^)U!, + • • • + (z° + ■ • • + =d 

{z°)Vl + (z° + z^)Vf + • • • + (z° + • • • + z^-^)Vf,. (84) 

By multiplying by (z — 1), using the definition of Ta?/, and adding 1 to both 
sides, we obtain Vz G C 

N'-l N'-l 

E E (85) 

i=o j=o 

Thus, U' and V have the required properties. □ 

We use the homeomorphism, hence measurable isomorphism of Tat/ with 
the collection of probability measures supported in {0 ,..., A^' — 1} given by 
V I—>■ vqSq + • ■ • + vn'-iSn'-i in order to see the following: 

Theorem 4.1.4. For N' large enough, there are two random probability mea¬ 
sures fi, V with distinet distributions whieh are a.s. supported in {0 ,..., A^' — 1} 
for which Vt G M, (ff^it) =d (fvit)- 

Proof. Obtain U',V',N' as in the last lemma, and set p = UqSq + ••• + 


and n = VqSq + ••• + Set z = e®* in (1821) so that 

its left side is the random characteristic function of p and its right side is the 
random characteristic function of v. This construction has the required proper¬ 
ties. 

□ 

4.2 Too Many Multiplicative Relationships Spoils Unique¬ 
ness of the Marginal Moment Problem 

Let us see that 4 values is again enough to prove nonuniqueness in the marginal 
version of the random moment problem: 
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Theorem 4.2.1. There exist /x, v random measures a.s. supported in {1, 2,4,8} 
for which Vfc > 0, fik =d Vk while yet /i v- 

Proof. By the identification of T 4 with the collection of probability measures 
supported in { 1 , 2, 4 ,8} (given by u i-)- uo( 5 i + V1S2 + V2S4 + 0363) we have that 
it suffices to find two random probability vectors U = (U'o,Ui,U2,U3),V = 
(Vb, Vi, V2, V3) for which U y^dV and V/c > 0 

V/fc > 0 , Uo * 1 ^= + C/i2'= + + 1738'= =d Vb * 1'= + Vb2'= + + V38^ (86) 

That this suffices is because upon defining p, = UqSi + U162 + U2S4 + 1/363 and 
V = Vbbi + ¥462 + V264 + Vbbgj which are random probability measures a.s. 
supported on {1, 2, 4 ,8}, we would have that the left side of ( 1551 ) is fik and the 
right side is Vk- 

We may write (( 551 ) as 


yk > 0, t7o*2°'= + [/i2i'= + 17222'= + 17323'= =d Vo*2°'^+ Vi2^'‘+ ¥ 22 ^'^+¥ 32 ^'^. (87) 


Pick U, ¥ from Lemma r2.3.6l 


□ 


4.3 How The Right Kind of Arithmetic Independence Can 
Help 

Let ao,, oat-i be a list of nonzero natural numbers which are pairwise co¬ 
prime. 

Theorem 4.3.1. If p,,v are random prohahility measures which are a.s. sup¬ 
ported in {oo,..., aw-i} and Vfc > 0, /ifc =d Vk then p, =d v. 

Proof. First we consider the homeomorphism between the space of probability 
measures supported on {oq, ..., oat-i} with Tn := {(ccq, ..., a:Ar-i)|Vj : 0 < j < 
N-1, Xj > ^3 = 1} given by 9 ^ (6<({ao}),..., 0({aAr-i})). It suffices 

to show that if t/, V are Tjy valued and VA: > 0 we have 

N-l N-l 

(88) 

3=0 3=0 

then U =d ¥. Once this is shown, if /i, v are a.s. supported on {oo,..., oat-i}, 
then upon defining 

U=(uo,..., Un-i'^ = (^M({ao}),..., A^({a^-i})) (89) 

and 

¥ = ^Vb,..., Vat-i^ = ^i^({ao}),..., i/({aAr-i})^ (90) 
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we would have that the left side of (1551) is fik and the right side is i^k- 

By Lemma [2.3.51 it suffices to show that {(a§,..., > 0} is not 

contained in any projective variety. 

Suppose to the contrary that there exists some nonzero homogeneous poly¬ 
nomial p in N variables of degree I > 0 for which \/k > 0, p{a 0i ■ • ■ 1 ^N-l) ~ 0- 
Enumerate (without repetitions) the monomials of degree I, and write 

p = J2f=i where bj € M. For each j, 3Cj G N such that 

Vfc>0, = (91) 

Because the Mj are distinct, and ao,, qn-i are all coprime, we find that all 
the Cj are distinct. Find jo such that Cj is the largest, subject to the constraint 
that bj ^ 0. This is a feasible optimization problem because p ^ 0. There will be 
only one optimal solution because the Cj are all distinct, and a solution exists 
because the list of Cj is finite. Consider \imk pia^,... = bj„ ^ 0 

for a contradiction with the fact that 'ik > 0, p(a§,..., cL%_i)/Cj^ = 0. This 
completes the proof. 

□ 


5 Acknowledgements 

The author would like to thank his adviser, Marek Biskup, for his part in con¬ 
versations concerning the present project. The author would also like to thank 
his oral exam committee, especially Tom Liggett, for helpful suggestions. The 
author is grateful to Jifi Cerny for suggesting some of the problems in this arti¬ 
cle. Finally, the author is thankful for funding for this project coming from the 
NSF award DMS-1407558. 


References 

[1] D. Aldous, Exchangeability and Related Topies. Springer Berlin Heidelberg, 
pages 1-198 (1985). 

[2] J. Cuesta-Albertos, R. Fraiman, T. Ransford, A Sharp Form of the Cramer- 
Wold Theorem, J. Theor. Probab. 20, 201209 (2007). 

[3] S. Evans, X. Zhou, Identifiability of Exchangeable Sequences with Identically 
Distributed Partial Sums, Elect. Comm, in Probab. 4, 913 (1999). 

[4] W. Feller, On Muntz’ theorem and completely monotone funetions. Amer. 
Math. Monthly 75, 342350 (1968). 

[5] D. Freedman, De Finetti’s theorem in continuous time, IMS Lecture Notes 
Monogr. Ser. 30, 8398 (1996). 

[6] A. Kechris, Classical Descriptive Set Theory, Springer-Verlag, New York, 
1995. 


32 




